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Abstract 

Iterated admissibility is a well-known and important concept in classical game theory, 
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e.g. to determine rational behaviors in multi-player matrix games. As recently shown by 



Berwanger, this concept can be soundly extended to infinite games played on graphs with 
w-regular objectives. In this paper, we study the algorithmic properties of this concept 
for such games. We settle the exact complexity of natural decision problems on the set 
.^^ of strategies that survive iterated elimination of dominated strategies. As a byproduct of 

our construction, we obtain automata which recognize all the possible outcomes of such 
strategies. 



H. 

rh ■ 1 Introduction 

Two-player games played on graphs are central in many applications of computer science. For 
example, in the synthesis problem for reactive systems, implementations are obtained from 
winning strategies in games with a w-regular objectives pQ. To analyze systems composed of 
several components, two-player games are extended to multi-player games with non zero-sum 
objectives, i.e. each player has his own objective expressed as a w-regular specification which 
VO \ is not necessarily adversarial w.r.t. the objectives of the other players. 

To analyze multi-player games in normal form (a.k.a. matrix games), concepts like the 
celebrated Nash equilibrium [2] has been proposed. Another central concept is the notion 
of dominated strategy [3j. A strategy of a player dominates another one if the outcome of 
the first strategy is better than the outcome of the second no matter how the other players 
play. In two-player matrix game of Fig. [TJ strategies of player 1 (of player 2 respectively) are 
given as lines of the matrix (as columns respectively), and the payoffs to be maximized, are 
given as pairs of integers (the first for player 1 and the second for player 2). Strategy B of 
player 1 dominates strategy A: no matter how player 2 plays, B provides an outcome which 
is larger than or equal to the one of A, and if player 2 plays D then the outcome provided 
by B is strictly larger than the outcome of A. On the other hand, player 2 at first sight has 
no preference between C and D. But if player 2 knows that player 1 prefers strategy B to 
strategy A, then he will in turn prefer D to C, and it is then reasonable to predict (B,D) 
will be played. This process is called the iterated elimination of dominated strategies, and 
it is valid under the hypothesis that rationality is common knowledge among the players [1]. 
Strategies that survive the iterated elimination of strategies are called admissible strategies. 



In [5] , Berwanger has shown that the notion of strategy dom- 
inance and iterated elimination of dominated strategies can be ~r 
soundly extended to infinite games played on graphs with u- R 
regular objectives. This extension is challenging as the set of 
strategies is infinite and may lead to infinite dominance chains. 
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Figure 1: A two-player ma- 
trix game. 



His main results are as follows: all iteration stages are domi- 
nated by admissible strategies, the iteration is non-stagnating, 

and, under regular objectives, admissible strategies form a regular set. In particular, for the 
last result, Berwanger suggests a procedure that uses tree automata to represent sets of strate- 
gies, as in [UJ. The closure of tree automata to projection and Boolean operations naturally 
provide an algorithm to compute admissible strategies in parity games but this algorithm has, 
a priori, non-elementary complexity. 

In this paper, we study in details the algorithmic aspects of admissibility in infinite games 
played on graphs. We provide techniques that avoid the non-elementary complexity of the plain 
automata-based approach. We study games with weak Muller and (classical) Muller winning 
conditions given as circuits. Circuits offer a concise representation of Muller condition and 
are closed (while remaining succinct) by Boolean operations. Weak Muller conditions define 
objectives based on the set of states that occur in a run, they generalize safety and reachability 
objectives. (Classical) Muller conditions define objectives based on the set of states that appear 
infinitely often in a run, they generalize Biichi and parity objectives. We study the winning 
coalition problem: given a game and two subsets W, L of players, to determine whether there 
exists an iteratively admissible profile that guarantees that (i) all players of W win the game, 
and (ii) all players of L lose the game (other players may either win or lose). For weak and 
classical Muller objectives, we provide a procedure in PSPACE, with matching lower-bounds 
for safety, reachability, and Muller objectives. For Biichi objectives, we provide an algorithm 
that calls a polynomial number of times an oracle solving parity games (hence this would lead 
to a polynomial time solution if a polynomial time algorithm is found for parity games - the 
current best known complexity is UP n coUP |7J). As a byproduct of our constructions, we 
obtain automata which recognize all the possible outcomes of iteratively admissible strategies. 

Related work. Dominance can be expressed in strategy logics [8, 9j but not unbounded 
iterated dominance. Bounded iterated dominance is expressible but leads to classes of formulas 
with a non-elementary model-checking algorithm. Other paradigms of rationality have been 
studied for games on finite graphs, like Nash-equilibria |1U| lll| or regret minimization [12] , 
In |11| . the authors build an automaton that recognizes all Nash equilibria. 

Organization of the paper. The rest of the paper is organized as follows. We first for- 
malize the setting and the notations in Section [21 Then we solve the case of games with safety 
objectives, in Section [3l which gives rise to a simple notion of dominance. We then give the 
more general algorithm and constructions for Muller objectives in Section UJ and generalize 
the algorithm for safety with weak Muller objectives in Section [5j We conclude by giving 
other applications of our techniques to other decision problems, in Section [6j 

2 Definitions 

2.1 Multiplayer Games 

We consider turn-based non-zero-sum multiplayer games. 

Definition 2.1 (Games). A turn-based multiplayer game is a tuple Q = (P, iVi)i & p, E, (WlNj)j 6 p) 
where: 

• P is the non-empty and finite set of players; 

• V = l+l ig p V% and for every i in P , V{ is the finite set of player i 's vertices; 



• E C V x V is the set of edgeo' We write s — >• t for (s,t) G £7 when E is clear from 
context. 

• for every i in P, WiNj C V^ is a winning condition. 

A path p is a sequence of state (pj)o<j< n with n G N U {00} such that for all j < n — 1, 
Pj —7- Pj+\. The length \p\ of the path p is to — 1. A history is a finite path and a run 
is an infinite path. Given a run p = {pj)jen an d an integer k, we write p<& the history 
(pj)o<j<k, that is, the prefix of length k + 1 of p. For a history p and a (finite or infinite) 
path p', p is a prefix of p' is written p © p'. The set of states occuring in a path p is 
Occ(p) = {v G V I 3i G N. i < |p|,pi = «}• The set of states occuring infinitely often in a 
run p is Inf(p) = {v G V | Vj G N. 3i < \p\. i > j,pi = v}. The last state of a history p is 
last(p) = p\ p \-i- 

Definition 2.2 (Strategies). A strategy of player i is a function o~i : (V* ■ Vi) —> V , such that 
if cri(p) = s then (last(p), s) G E. A strategy profile for the set of players P' C P is a tuple of 
strategies, one for each player of P' . 

Let Si(Q) be the set of all strategies of player % in Q; we simply write Si when Q is clear 
from the context. We write S = \\ i&P Si for the set of all strategy profiles. We also write <S_j 
the set of strategy profiles for all players but i. If <t_j = (o~j)jeP\U} G 5_j, we write (<7j,<7_i) 
for (aj)j & p. Similarly, if S is a set of profiles, S% denotes the i-th projection of S, i.e. a set of 
strategies for player i. 

A strategy profile op G S defines a unique outcome from state s: Out s {op) is the run 
p = (pj)j g N such that po = s and for j > 0, if pj G Vi, then pj + \ = o~i(p<j). If Si is a set of 
strategy for player i, we write Out s (Si) for {p | 3<7j G Si,a-i G <S_j. Out s (ai,a-i) = p}. For 
a tuple of sets of strategies Sp> with P' C P, we also write Out s (Sp>) = HieP' Out s (Si). 

A strategy ctj of player i is said to be winning from state s, if for all <t_j G 5_j the outcome 
of (<7j, cr_j) from state s is in WlNj. If o~i is winning from s for all states s we simply say that 
it is winning. For each player i, we write WlNf (ap) if Out s (ap) G WlNj. 

A rectangular set of strategy profiles is a set that can be decomposed as a Cartesian 
product of strategy sets, one for each player. 

Definition 2.3 (Subgame). A subgame ofQ is a game on a subset ((V^')jgp, E') o/((Vi)i g p, E) 
such that each vertex ofV = (+J ie p V( has at least one successor by E' . By abuse of notation, 
if T denotes a set of transitions (resp. Q a set of vertices), the game Q\T is the game on the 
graph (V,E\T). 

If Q' = (V',E') is a subgame of Q, a strategy a in Q is a strategy in Q' if for any run 
p G V'*, a{p) G V . The set of these strategies is written S{Q'). A set of strategies S can be 
restricted with respect to a subgame Q' C Q: S[Q'\ = S (1 S{Q'). 

Transition-based strategy sets. A set Si of strategies of a player i is transition-based if 
it is the set of all strategies of player i in some subgame Q' ', i.e. if there exists T C E such 
that Si = Si{Q \T). A set of profiles which is the product of transition-based strategy sets is 
also called transition-based. 

Winning conditions. In this work, we consider that winning conditions for each player 
are given by Boolean circuits [13] . either on the states occurring along the run, or the states 
occurring infinitely often. We also distinguish the particular cases of safety, reachability, and 
Biichi winning conditions. 



1 It is assumed that each vertex in V has at least one outgoing edge. 



• A safety condition is defined by a set Badi C V. A run is winning for player i if it never 
reaches a state of Badf. WiNj = (V \ BadiY . 

• A reachability condition is the dual condition. It is defined by a set Goodi C V. A run 
is winning for player i if it reaches a state of Goodi: WiNj = V* ■ Goodi ■ V^ . 

• A Biichi condition is defined by a set FjCK A run is winning for player i if it visits a 
state of Fi infinitely often: WIN, = (V* • F») w . 

• A circuit condition is given by a Boolean circuit whose inputs are all the states of V. The 
circuit for player i thus encodes a Boolean formula (/?» which has states as free variables. 
A run p defines a valuation through the set of states visited infinitely often: v p (s) = 1 if 
s € Inf(p) and v p (s) = otherwise. Then WiNj = {p\v p \= ipi}. 

• A weak circuit condition is given in the same way except that the inputs concern states 
occurring during the run (not necessarily infinitely often): v p (s) = 1 when s € Occ(p) 
and then WiNj = {p | v p (= (fi}. 

Circuit conditions generalize Biichi and other classical conditions such as parity or Muller, 
in that these can be encoded by a circuit of polynomial size [13| . In the same way, weak 
circuit conditions generalize safety and reachability; it can also easily specify conjunction 
of reachability or disjunction of safety for instance. Note that circuit conditions are prefix- 
independent, that is to say that for any finite path p and infinite path p', p ■ p' G WiNj 44> 
p' € WiNj. In two-player games with a circuit condition, deciding the winner is PSPACE- 
complete [13]. In the sequel, we treat first safety conditions since they give rise to a simple 
algorithm, then prefix-independent conditions, and finally weak circuit conditions. 

2.2 Admissibility 

Definition 2.4 (Dominance for strategies). Let S C S be a rectangular set of strategy profiles. 
Let a, a' G Si C Si and S—% C <S_j. Strategy a weakly dominates strategy a' with respect to S, 
written a ^5 a' , if from, all states s: 

Vr e S-u Wml(a',T) => WlN|(a,r) 

Strategy a strictly dominates strategy a' with respect to S, written a ^5 a' , if a ^5 a' and 

A strategy a G Si is dominated in S if there exists a' £ Si such that a' yg a. A strategy 
that is not dominated is admissible. 

In the above definition, the subscripts on )? and >- may be omitted if the sets of strategies 
are clear within the context. 

The set of iteratively admissible strategies is the fix-point of the operator that associates 
to a rectangular set of strategies the rectangular set of its admissible strategies, starting from 
the set S. We write S n the rectangular set of strategies obtained after n steps of elimination 
(and thus 5° = S) and S* the fix-point. Note that this fix-point always exists and is reached 
after a finite number of iterations [5] . 



Example 2.5. Figure 2(a) presents an example of a safety game. We assume the game starts in 
qo. The strategy of player 1 that from state go goes to (74 are sure to make him lose. Whereas 
if he goes to state q%, there is a strategy of player 2 which helps him winning. Hence a strategy 
that chooses q^ is dominated by the one that chooses gi, and it will be eliminated at the first 
iteration of the elimination of dominated strategies. 
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(a) A safety game. 



(b) The transitions eliminated after two steps of 
elimination are dotted. 



Figure 2: A safety game and its unfolding. States controlled by player 1 are represented with 
circles and states controlled by player 2 with squares. We will keep this convention through 
the paper. Label i next to the name of the state denotes that it belongs to Bad{. 

Winning coalition problem. The winning coalition problem is, given a game Q and two 
subsets W, L of players, to determine whether there exists an iteratively admissible profile 
that guarantees that all players of W win the game, and all players of L lose the game (other 
players may either win or lose). 

Values. The algorithms throughout the paper are based on the notion of value of a history. 
It characterizes whether the given player can win (alone) or cannot win (even with the help 
of other players), restricting the strategies to the ones that have not been eliminated so far. 
This notion is a central tool in [5] to characterize admissible strategies. 

Definition 2.6 (Value). The value of history h for player i after the n-th step of elimination, 
written Val"(/i), is given by: 

• if there is no strategy profile ap inS n whose outcome p from last(/i) is such that h < ^_ 1 -p 
is winning for player i then Val"(/i) = — 1; 

• if there is a strategy of <Tj G Sf such that for all strategy profiles er_j in <S" i; the outcome 
P °f (°~i,o~-i) from s is such that ft.<i/,i_i • p is winning for player i then Val™(/i) = 1; 

• otherwise Val"(/i) = 0; 
By convention, Val~ (h) = 0. 



To illustrate the link between the value and strictly dominated strategy, we can already 
state this simple property: 



Lemma 2.7. For any n, i/last(/i) G Vi and ai G <S™ + then Valf (h) = Val"(/i • ai{h)). 

Hence a player which plays according to an admissible strategy cannot go to a state with 
a different value. This condition is not always sufficient, but in the following sections, we will 
characterize runs of admissible strategies, relying on this notion of value. 



3 Safety objectives 

In this section, we provide an algorithm for safety conditions. The main result is stated in the 
following theorem: 



Theorem 3.1. The winning coalition problem is PSPACE-complete. 



Proposition 3.2. For safety winning conditions, the value of a history only depends on the 
players that have already lost and on the last state. 

Proof. Since a safety objective can be transformed into a prefix-independent one by remember- 
ing which player have already lost, this is a consequence of the fact that for prefix- independent 
objectives the value depends only on the last state of the history |4"U1 □ 

We will therefore write Val"(A,s) for Val"(/t) where A = {i G P j 3k < \h\. h k G Badi} 
and last(/i) = s. This yields a local notion of dominance for safety conditions. Moreover, 
in this case the necessary condition of Lemma 12.71 becomes sufficient, as we show in the 
sequel. We encode the set A in the state of the game, through an unfolding - at the price 
of an exponential blowup. The unfolded game has vertices in 2 P x V and set of transitions 



(A, s) — > (AU {i | s' G Badi}, s') for any A C P, if s — > s'. For example, the game of Figure 2(a) 
is unfolded as the game of Figure [2(b) [ states q' , . . . , q± are states where player 1 has already 
lost. In the following of this section, it is assumed that game Q is already unfolded. 

3.1 Admissible Strategies in the Unfolded Game 

For safety conditions, the dominance can be expressed by a local condition that applies the 
concept of value to transitions. 

Definition 3.3 (Dominance for transitions). We write TJ 1 for the set of transitions s —> s' £ 
E, such that s is controlled by player i and Val™(s) > Val™(s'). Such transitions are said to 
be dominated after the n-th step of elimination. We also write T n for the union of all TJ 1 . 

Now, we need to establish links between the two notions of dominance. Note that since 
all states s have at least one successor with a value greater or equal to that of s, removing 
transitions of TJ 1 do yield a subgame. 

Proposition 3.4. All strategies of S(Q) \S{Q \TJ l ) are dominated with respect to S n . 

Proof. Since the objective is now prefix independent, we can use the more general result of 
Lemma 14.91 proved in the next section. Namely, if s G Vi, o~i G 5™ + then for any history h, 
Val"(s) = Val™(s') where s' = Oiih ■ s). Hence no strategy which takes a transition in TJ 1 can 
bein<S™ +1 . □ 



Example 3.5. Consider the example of Figure 2(a) Initially, the state q^ has value —1 for 



player 1, but qo has value since it is possible to loop in q\ and q$ (if player 2 wishes so). 
Hence the transition to state q^ is dominated, it should be removed at the first iteration. After 
that, player 2 has a winning strategy from q\, by always going back to qo, whereas the state q 2 
has value for him. Hence q\ — > q' 2 is removed after this iteration. The fix-point is obtained 



at that step, it is represented in Figure 2(b) 



The previous result states that removing dominated transitions only removes strictly dom- 
inated strategies. The converse is also true: all strategies that remain are not dominated, 
which leads to the following result: 

Proposition 3.6. // S n is transition-based, then all strategies of S{Q \ TJ 1 ) are admissible 
with respect to S n . 

Proof. Let o-i,a[ G Si{Q \ TJ l ) and assume o\ >~s^ (Ji- Then there is a state s and strategy 
profile a^i G <S"j such that WlNf (a[, o^i) A -Win| (<7j,<7_j). Let p = Out s {ai,a^i) and 
p' = Out s (a' i ,a-i). Consider the first position where these runs differ: write p = w ■ s' ■ S2 • w' 
and p' = w ■ s' ■ s\ ■ w" . Note that s' belongs to player i. 

First remark that since WiNj(a^, <t_j), it is clear that Valf (s±) > 0. Moreover, since s' — > si 
and s — >■ S2 do not belong to TJ 1 , states s', s\ and S2 must have the same value. 



• Assume Valf (a') = 0. We show that there is a profile^ &-i & S-i such that WlNj (<7j, crLj 
from S2- 

Let T n ~ l be the transitions defining the set of strategy S n : i.e. S n = S(Q \ T n ). Note 
that if all the successors of a state a" by transitions that are not in T n_1 have value — 1, 
then Val"(s") = — 1. Therefore it is possible to define a strategy profile o 1 ^ £ S^ that 
never decreases the value from or 1 to — 1. The strategy Oj itself does not decrease the 
value of player i because it does not take transitions of T™. So the outcome of (<7j, ct 2 t ) 
never reaches a state of value —1. Hence it never reaches a state in Badi and therefore 
it is winning for player i. 

Now, Valf (si) = so there is no winning strategy for player i from s± against all 
strategies of 5™j. Then there exists a strategy profile o\ i G S n i i such that a\ loses from 
s\. Now consider strategy profile a'^ that plays like <t_j if the play does not start with 
w, then at-i after si and a 1 ^ after a-i- Given a history h: 

{al^ii/Si) -1 /;.) if ws\ © h 
o- 2 S((ws 2 y 1 h) ifws 2 ©h 
<j~i(h) otherwise 

Clearly we have WlNf(<7i, <ri.J A -iWinKct^o-^), which contradicts o[ )^s n &i- 

• Now assume Valf(s2) = 1. Since -iWlNj(o"j,cr_j), the produced outcome p reaches a 
state of Badi, hence the value of states along p is — 1 after some point. Consider the first 
state pk which has value smaller or equal to 0: k = minfc/{/9fc/ | Valf (pk') < 0}. The state 
Pk-i has value 1, it is necessarily controlled by a player j different from player i, since 
transitions of T" cannot be taken by Oj. Since there exists a winning strategy <Tj € 5™ 
from /Ofc_i against strategies of 5™ i7 then this strategy is still winning at p&. Therefore 
Val™(/9fc) = 1, which is a contradiction. □ 

Theorem 3.7. The set of admissible strategies with respect to S n is the transition-based set 

s{g\r n ). 

This result yields a polynomial procedure in the unfolded game to compute the set of all 
iteratively admissible strategies: 

• for each state, compute its value in the following way: if there is a winning strategy for 
player % from s in the game Q \ T n , then Val"(s) = 1; if there is no winning run for 
player i from s in Q \ T n , then Valf(s) = — 1; otherwise Val"(s) = 0; 

• remove dominated transitions; 

• start again until no transition is dominated (this can happen at most \E\ times, where 
\E\ is the number of transitions in the unfolded game). 

However, this procedure assumes that the information of whether the game has already 
been lost for each player is encoded in the state. So in the general case, the procedure is 
exponential in the number of players (but still polynomial if the number of players is fixed). 



2 Although the definition of the value yields the existence of a profile winning for i, it remains to be shown 
that there is such profile where i plays strategy Oi. 



3.2 The winning coalition problem for safety objectives 

The EXPTIME procedure described in the previous section computes all admissible strategies. 
However, for deciding the winning coalition problem, only the existence of a particular profile 
is required. This enables to prove PSPACE membership for theorem 13.11 by guessing a lasso 
path produced by such a profile, and checking recursively that no dominated transition was 
taken. 

This theorem is proved in the following two lemmata. 

Proposition 3.8. The winning coalition problem is in PSPACE. 

Proof. First remark that although there is an exponential number of copies of the game over 
the graph (V, E) that need to be considered with respect to which players have already lost, 
states can be ordered the following way: we say that (A, s) < (A', s') if A C A'. Along any path 
the states are increasing for this order, it can increase strictly at most \P\ times, and there are 
at most \V\ equivalent states. In addition, the value, hence the elimination of transitions, only 
depends on the values of greater states, so the iterations stops after at most \P\ ■ \E\ phases. 

Therefore a procedure to find an iteratively admissible strategy winning at least for players 
of W and losing at least for players of L consists in guessing a lasso path p that ends in a copy 
where W has not lost and L has. This path has length bounded by \P\ ■ \Q\. 

However the algorithm needs to check that each transition taken by p has indeed survived 
the elimination of transitions: this transition should not be dominated by any other. This is 
done by recursively checking that a transition has survived the j'-th elimination phase. Note 
that the (recall that there can be at most \P\ ■ \E\ such phases). For a transition p^ — y pu+i to 
survive the j'-th phase, the value of pu+i needs to be the same than that of p^ for the player 
controlling s. 

To check Val"(pfe), we use the following procedure: 

• if we fail to guess a lasso which does not intersect with Badi in Q\T n from state pk, then 
Val™(pfc) = — 1. Note that looking for a path in Q \ T n implies recursively computing 
some values of iteration j — 1; 

• if there is a winning strategy for player i in the safety game Q \ T n with target Badi, 
then Val"(/9fc) = 1; note that this can be done by finding a strategy that either never 
visits a new set Badj (hence not increasing for <) or visiting a new set Badj through 
a state of value 1 for i (this value being computed recursively, for details, see the more 
general proof of Theorem 15. 1[) . 

• in the other cases Val"(/9fc) = 0. 

In all cases, the recursive calls can stack up to ... , since they always traverse upwards (for <) 
the set of states. □ 

Proposition 3.9. The winning coalition problem is PSPACE-hard, even for sets of players 
W,L C P such that \W\ = 1 and L = 0. 

Example 3.10. The hardness proof of theorem 13.11 is done by encoding an instance of QSAT 
into a multiplayer game with safety conditions. The construction is illustrated in Figure [3] for 
the formula p = EbiVa^a^xi V xi V ~^xs) A (->xi V xi V X3). There are two players x and 
-ice for each variable x, plus two players Eve and Adam. The moves of Eve and Adam in the 
left part of the game determine a valuation: Xi is said to be true if Badi was reached. If a 
player Xj has not yet lost, in the right part of the game, it is better for this player to visit the 
losing state of Eve than its own. Hence, at the first step of elimination, the edges removed 




Figure 3: Game Q^ with fj, = BxiVa^a^xi V x^ V -1X3) A (~>xi V X2 V X3). A label y inside a 
state s denotes that s G Bad y ; a label y fre/ow a state s denotes that s E V y . Note that Eve is 
abbreviated to 3 and Adam is abbreviated to V. 



in the unfolded game correspond to the ones going to a state Bad Xi if Xi is false (and -ixj 
if Xi is true). At the second step of elimination, Eve should avoid whenever possible, states 
corresponding to a litteral whose valuation is not true, since those states will necessarily lead 
to Bad^. If the valuation satisfies each clause, then she has the possibility to do so, and one 
admissible profile is winning for her: so \i is true if, and only if, there is a admissible profile 
where Eve is winning. 

Proof. We encode a instance of QSAT into a game in which there is an admissible strategy 
profile which is winning for Eve if, and only if, the formula is valid. 

Given a formula eft = 3xiVx2 ■ ■ • ip we associate a game Q& in which there are one player for 
each literal Xi or ->Xj and two players Eve and Adam. The construction is recursive separately 
over the quantifiers and over the propositional part. If ip is a propositional formula: 

• If ip = Xi then we define the module M^ in which player Xi has a choice between making 
Eve lose or lose himself and let the game continue, this is represented in Figure |4(a)| 



If 



• If ip = ->Xi then the construction is similar, with player —<Xi replacing X{, see Figure 4(b)[ 

• If ip = tpi A ip2 then we put the modules M^ and M^ 2 in sequence, see Figure 4(c) 

• If ip = Vj ipi then Eve has the choice between all modules M^, see Figure [4(d) 
is a quantified formula: 

• If (f> = 3xi. (pi then Eve has the choice between making Xi or ~^x% lose before continuing 



to M ( p 1 , see Figure 4(e) 

• If (p = Vxj. (p\ is similar but Adam controls the choice, see Figure [4(f) [ 

Finally Gd> is obtained by directing the remaining outgoing transitions of Ma, to a state losing 
for Adam, see Figure 4(g) A full example of Q^ with \x = 3xiVx23x3(xi V X2 V -1X3) A (->Xi V 
x 2 V X3) is given in Figure O Note that any run in Q^ winning for Eve is losing for Adam, and 
vice versa. 

Given a history of the game, we write A(/i) = {p \ 3i. hi £ Bad p } the set of player who 
already lost on that path. We associate to such a set of players A, a partial valuation v\ such 





AM* 



(a) M Xi 



(b) M^ Xi 




M* 



M* 



(c) M 0lA 2 




(e) M 3xi . fa 



(g) 



Figure 4: Modules for the definition of the game Q*. 



that: 



V\{Xi) 



1 

undefined 



if xi £ A 

if -iXi G A A Xi 

otherwise 



Note that upon entering M^, the module for the propositional part of 4>, v\ is a valuation over 
variables {xj}j: each variable had exactly one literal visited. We write v^\/ this valuation. 

Let £ be a literal. Let 5} be the set of strategies of player £ admissible with respect to the 
all other strategies, i.e. Sj is the set of admissible strategies after one elimination phase. We 
claim that Sj is exactly the set of strategies that, given a history h such that £ ^ X(h) and 
last(/i) € Ve, do not take the transition to state labeled £. 

Indeed, if such a transition is taken by strategy <7j, player Xi loses while the strategy u\ 
that mimics Ui up to this M Xi module then chooses the other transition is winning in this case 
and preforming in the same way otherwise, thus a^ >- Oi. 

Now if Oi is a strategy that never chooses the transition to states labeled £ unless £ G X(h). 
Assume u\ >- o-i. Let <r_j be a profile for the other players such that Wm^a'^a^i) and 
-iWlN^(<jj,a_j). Consider the first time Oi and o^ diverged in these plays, after a history h. If 
£ £ A(/i), both plays are losing, hence it is the case that £ ^ A(/i). According to its constraints, 
Ui chooses to go state losing for Eve, and thus wins since no other state, hence no state labeled 
£, is ever visited, which is a contradiction. 

Remark that now all the choices that remain for player £ is when he has already lost. Thus 
the set of admissible strategies for player £ is stabilized for these players after one iteration. 

The set of strategies S^ ve and Sl dam of admissible strategies for the first iterations for 
players Eve and Adam, respectively, are identical to the initial sets of strategies for these 
players. Indeed, Eve can be made to lose or win by the coalition of other players regardless 
of her choices. Since the objectives of Adam and Eve are opposite, this is also the case for 
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Adam. For any history that is not already in a sink state where Eve has lost (then nobody has 
choices), other players can play the two following profiles: 

1. To make Eve win: 

• when in a module Mg, player £ always chooses to go to the state labeled £ (even 
though he loses); 

• what Adam plays is irrelevant. 

This ensures progress toward the end state where Eve wins (and Adam loses). 

2. To make Eve lose: 

• when in a module M#, player £ always chooses to go to the state labeled 3; 

• what Adam plays is irrelevant. 

Since these modules are encountered for every path Eve may choose, she loseajj (and 
Adam wins). 

First, assume that <p is satisfiable. We then show that the admissible strategies of Eve 
in the second phase of strategy elimination, Sg ve , are the ones corresponding to a satisfaction 
of (p. Namely, the choices of Eve in choosing the value of existentially quantified variables 
should yield a true propositional formula ip, which truth is proved by Eve choosing the proper 
clause in the case of disjunctions. Indeed, if Eve follows such a strategy the only modules Mi 
entered are ones where literal £ has been set as true by valuation ugy- So player £ has already 
lost in the history of the play, hence transitions to states labeled by £ are possible. Since it 
is still possible to make Eve lose from these states, one can still devise strategy profiles of 
other players that cooperate only with a given strategy of Eve, thus ensuring that it is not 
dominated. 

On the other hand, if a false literal £ is encountered, which will occur if the valuation vjy 
does not satisfy ip or if Eve tries to validate a false part of a disjunction, then the player £ 
has no choice but to make Eve lose, since he must play a strategy of Sj. So all strategies that 
do not correspond to the validation of (p are losing even with cooperation of other players, so 
they are not admissible!. 

Similarly, admissible strategies of Adam, Sf dam , require him to choose, if possible (that 
means if Eve picked the wrong value for a variable), values for universally quantified variables 
that makes ip false. 

The iteration of admissible strategies stops after these two steps. Indeed, the only difference 
from Eve's point of view is the strategies of Adam, which cannot change the result provided 
Eve plays to satisfy (p. Conversely, Adam has no better choice than to try to falsify the formula, 
even if this case does not arise anymore since strategies of Sf ve do not make such mistakes. 

Therefore the iteratively admissible strategies of Q<f, are the ones in Sf ve x Sf dam x 5* x 
S\ X1 x • • • . And for any strategy of Sf ve , the strategy profile such that all literal players chose 
to go to £ whenever possible (i.e. whenever they have already lost) is winning for Eve. 

Now assume that <p is n °t satisfiable. On the other hand, strategies for Adam are not 
dominated, S% dan , are actually winning: Adam can choose to play a valuation such that u^y ^ ip- 
With such a valuation, for any choice of Eve in the disjunctions, a module Mi is eventually 



Unless (f> is the empty formula, in which case the game is only the sink state, thus there are no real strategies. 
'Since some admissible strategy exists. 
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encountered where V3\/(£) = 0, so player I has no choice but to make Eve lose, or equivalently 
to make Adam win. 

Any further elimination is thus useless: any iteratively admissible profile has a strategy 
for Adam that makes him win, so Eve loses. □ 

As shown in the above proof, the complexity stems from the number of players rather 
that from the number of necessary iteration needed to reach the set of iteratively admissible 
strategies: 

Corollary 3.11. Deciding whether there exists a profile op of strategies admissible after 2 
iterations such that Occ(Out(op)) n Badi = is PSPACE-hard. 

4 Prefix-independent objectives 

In this part we assume that objectives are prefix- independent. Our main result is stated in 
the following theorem: 

Theorem 4.1. The winning coalition problem with a circuit condition for each player is 
PSPACE-complete. 

PSPACE-hardness is directly derived from PSPACE-hardness of two-player games with 
circuit conditions. The main idea of the algorithm is similar to the ones we developed for 
safety conditions: we construct a graph represention of the outcomes of admissible profiles. 
The construction also relies on the notion of value, it is however not as simple as for safety 
conditions: it is for instance possible that a run which stays in states of value 1 is not winning. 
In section ??, we characterize admissible runs depending on the value of states they reached. 
In section 14.31 we construct automata using this characterization to recognize admissible runs 
and iteratively compute values of states. Finally in section POl we detail the algorithm. 

4.1 Shifting of strategy profiles 

In the case of prefix-independent objectives, each player can, at any time change his mind. In 
fact, it is possible for a strategy to shift to another (admissible) strategy. 

Definition 4.2 (Shifting). Given two strategies o 1 and o 2 , and a history h, we denote by 
o 1 [h <— <7 2 ] the strategy o that follows strategy o 1 and shifts to o 2 after history h. Formally, 
given a history h' : 

a (h') = S a2 ( h ~ lh ') tfh©ti 
\ cr 1 (/i / ) otherwise 

We say that a strategy set S allows shifting, if for any o 1 and o 2 in S, and every history h we 
have o 1 \h <— a 2 ] £ S. A rectangular set of profiles allows shifting if all its components do. 

Definition 4.3. We write o~i o h the strategy: 

|_ o~i(h') otherwise 

Strategy o~i o h thus plays as if Oi was played after a history h. However, if the history does 
not start at the end state of h, this would be inconsistent; in that case o~i o h plays like <Tj 

Lemma 4.4. If S n allows shifting, h is compatible with a strategy profile (o~j)jep of S n and 
Oi is in 5™ + then o,-, o h is in <Sf + . 



12 



Proof. Assuming o~i admissible with respect to <S n , we prove that a% o h is also admissible, i.e. 
not strictly dominated. 

Consider a strategy a\ £ Sf. We show that a[ ^5.1 Oi o /i, which shows that ctj o h is in 
iS"" 1 " . First, if <7j o /i ^ 5 n a^, then clearly er^ )fs n o~i ° h. 

Otherwise <7j o /j ^ 5n cr^. We write a" = Oi\h <— 0^] for the strategy profile that plays 
according to <7j until history h and then shifts to a[. 

Since a\ is not weakly dominated by o~{ o h, there is a state s and a profile t_j £ 5"^ such 
that Out s (r-i, o~D € WiNj and Out s (T-i, Ujo/t) does not win for i. Note that since o~i and <Tjo/i 
are identical except when starting from state last(/i), it must be the case that s = last(/i). 

We define the strategy profile r'_ i = a-i [h <— r_»] that follows cr_i and until /i then shifts 
to r_j. Recall that a-i is a profile of strategies of 5™^ such that h © Outh Q {a-i,a-i). We 
have that Outh (T'_i, o~i) = h- Ow£iast(h)(' r -i> °i ° ^) is losing for player i, and Outh {T'_^ a" ) = 
/i • Ouii ast (/j)(r_j,cr^) is winning for player i, by prefix independence. Moreover t'_ { € 5"^ 
because .S™ allows shifting by hypothesis. So (7j does not weakly dominate a": Oi )£s n °~'l- 

Since <7j is not strictly dominated, in particular a" )/-$" o~i- And by the above result 
Oi )£s n °~i, so it must be the case that u'[ ^s n °~i- Hence, there is a strategy profile r_j 
and a state s' such that Out s i(r-i,ai) is winning for player i and Out s '(T-i,cr") is losing 
for player i. Since <jj and <r" are identical except after history h, this means that s' = ho 
and that h is a prefix of both Outh (j-i,ai) and Outh (T-i,a"). We therefore have that 
Owiiast(h) ( r -« oh,(JiO h) is winning for player i but Out\ ast ^ (r_j o /i, <r" o /i) is losing for i from 
last(/i). Since a" o h = cr^, this means that <r^ does not dominate Gioh. □ 

Lemma 4.5. For any integer n, S n allows shifting. 

Proof. The proof is by induction over n. For the case n = 0, the property obviously holds 
since all strategies are in 5°. Assuming the property holds for n, we show it holds for n + 1. 

Let a 1 and a 2 be two strategies of <S™ + and h a history compatible with a profile of 5" . 
First, if there exists a winning strategy against all profiles of S™ i} then all strategies of 5™ + 
are winning strategies. In particular it is the case for both a 1 and a 2 . By prefix-independence, 
it is also the case for a 1 \h <— a 2 ] , hence a 1 \h <— <r 2 ] E <S™ + . Therefore we assume that there 
is no winning strategy against all profiles of 5"^. 

Let a 3 G 5™, we show that a 3 ^s« cr 1 [/i «— <r 2 ] . Without loss of generality, a 3 can be 
assumed admissible: <r 3 € 5" +1 . Lemma [4~T4~1 ensures that a 2 o h E 5™ +1 and a 3 o h € 5™ +1 . 
Since they are both admissible though not winning strategies, there exists a profile r_j such 
that a 2 oh wins while a 3 oh loses from last(/t). Since a 1 and <r 3 are also both admissible, there 
is also a profile r'_ i that makes a 1 win and a 3 lose. Consider now profile T"_ i = t': [h <— t_j]. 
We show that p = Outh^r'^,0- 3 ) is losing for player i while p' = Outh (T > !_ i , a [h <— <r 2 ]) is 
winning for player i. 

If h is not a prefix of the run Outho(T'_i, o~ 3 ), then this losing outcome is exactly p. If h is 
a prefix of Out^r^a 3 ), then p = h ■ Out(r-i,a 3 o h) which is a losing outcome, by prefix 
independence. 

Similarly, if h is not a prefix of Ou^ (ri i ,o" 1 ), then this winning outcome is exactly p' . 
And if h is a prefix of Outh (t^, a 1 ), then p' = h- Out(j—i, o 2 o h) which is a winning outcome 
for player i, by prefix independence. □ 

4.2 Characterizing outcomes of admissible strategies 

Proposition 4.6. For prefix-independent objectives, the value depends only on the last state 
of the history. 

Proof. Let h,h' be two different histories with last(/i) = last(/i'). Assume Val" + (h) = 1. 
Then i has a strategy <7j starting from that wins against all profiles of S r ^ i . Then playing 
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like o"j after h', namely switching to o~i o h which is a strategy of <S" by Lemma 14.41 is still a 
winning strategy so Val™ + (h) = 1. 

Assume Val™ + (h) = —1 and by contradiction that Val™ + (h') > — 1. Then there exists 
a profile op € 5 n such that op wins from /i'. So playing like oj» after h, namely playing 
op o h! £ 5 n , is also winning w.r.t. WiNj. Therefore it is not the case that Val™ + (/i) = —1. 

The case of Val™ + (h) = is then obtained by definition of value. □ 

Hence we write Val^(s) instead of Val?(/i) when last(/i) = s. Since Val^ is here a function 
from V to { — 1,0,1}, it can be extended to runs: VaLy (p) is the word w € { — 1,0, 1} W such 
that Wk = VaVj(pk) for all k. 

Lemma 4.7. For any n, if s £ Vi, s — >■ s' wi/t Valf (s) = Val™(s'), i/ien /or any strategy 
Oi € 5 ra+1 i/iai is admissible, the strategy o^ defined by 

o-'i(s) = s' a[{s ■ h) = Oi(h) a[(h) = a^h) if h / s 

is also an admissible strategy of S n+1 . 

Proof. The case where Val™(s) = 1 (resp. Val™(s) = —1) is trivial since <Tj is a winning (resp. 
always losing) strategy, then so is o\. 

Otherwise, assume Val"(s) = Valf (s') = 0. Let r% £ <SJ\ We only consider what happens 
in s, since otherwise a[ behaves the same as o~i. If Ti(s) = s" ^ s', then Val™(s") < so there 
is a profile that makes Tj lose from s" hence from s. Additionally, a profile exists that makes 
0"j win from s', hence it makes a[ win from s. 

If Ti(s) = s'. Since o~i is admissible, tjos )/~s n &i- 

• If there is a profile that makes U{ win but Tj o s lose, it also makes a[ win and Tj lose. 

• Otherwise every profile that makes r^os win also makes a, win, hence all profiles that 
make Tj win also make a[ win. □ 

Lemma 4.8. For any integer n and states s, s' such that s — > s' , if s is controlled by i then 
Val?( S )>VaJ?(a'). 

Proof. Assume s is controlled by i: 

• if Val"(s') = —1 then the property is obviously true. 

• if Val"(s') = then there exists a strategy profile up € S n that makes player i win from 
s' '. We define the strategy a[ that plays from s to s' and then follows cr^: 

o-[{s) = s 0"j(s • h) = o~i(h) °"i(^) = a i(.h) if ho ^ s 

Strategy a\ is a strategy of «Sf by Lemma 14.71 The strategy profile o^% [s ■ s' <— Oj^%\ 
is in S n because of Lemma 14.51 The outcome of {a[, Oj^i [s ■ s' 4— Pj^i]) is then winning 
from s by prefix independence. The value of s is therefore at least 0. 

• if Val"(s') = 1 then there exists a strategy o~i € S™ that is winning for player i from s' for 
all the strategy profiles in Yl^j S™. Consider the strategy a\ that plays from s to s' and 
then follows o"j. Let a'- -^ be a strategy profile in Yl^j <S?. By Lemma F4T41 a'-, { o (s ■ s') 
is a strategy profile in Yl^S?- Strategy Oi is winning against a 1 - /• o (s ■ s') from s' 
and by prefix independence a\ is winning against cr'-^ from s. Therefore the value of s 
is 1. ' □ 
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Lemma 4.9. For any n, if s G V, and u\ G <S™ then for any history h, Val™(s) = Val"(crj(/j- 
*))■ 

Proof. By the previous lemma the value cannot increase. If player i plays an admissible 
strategy <7j € 5™ + , we show that it cannot decrease. Let s' = o~i(h ■ s) 

• If Val" (s) = 1, then ctj is a winning strategy. Since there is no such strategy from a state 
with value Val™ < 0, Valf («') = 1. 

• If Val™(s) = 0, then there is a profile ct_j G <S™j such that p = Out(ai,o~-i) G WlNj. 
Note that h-s-s' ©p. If Val"(s') = —1, there can be no such profile, thus Val"(s') > — 1, 
hence Vales') = 

• If Val" (s) = — 1, there can be no lower value so Valf(s') = — 1. □ 
Lemma 4.10. For any state s, if p G 0wi s (5™ i ,5f +1 ) then Val"(p) G 0*l w + W + 0*(-l) w . 
Proof. Let p be the outcome of a strategy profile ap G S n and fc > be an index. 

• If Val"(/9fe) = — 1 and Val"(pfc+i) > 0. There is a strategy profile a P in 5 n that is winning 
for player i from pk+i- By Lemma H31 and Lemma HTH ap o (p<fc) [pfe+i ^— crp] is in S n . 
It makes player i win from p^- It is a contradiction with the fact that Val"(pfc) = — 1. 

• If Val"(/9fe) = 1 and Val™(/9fc + i) < 0. There is a strategy profile in S n that makes <Tj op< fc 
lose from pfc+i- On the other hand, since Valf(pk) = 1 there is a strategy u[ that is 
winning for player i against any strategy of S n . Hence o~i o p <k is dominated by a[ 
with respect to S n . By Lemma 14.41 this means that <Tj is dominated. Therefore p is not 
compatible with a strategy in 5" + . 

Therefore all the paths compatible with a profile in S n and a strategy in 5™ + have value of 
the form 0*1^ + (T + 0*(-l)^. □ 

In the following of this section we will characterize outcome of admissible strategies ac- 
cording to whether they end with value 1, or — 1. 

4.2.1 Value 1. 

To be admissible at step n of elimination, from a state of value 1, a strategy has to be winning 
against all strategies of S n . This is characterized by the next lemma. 

Lemma 4.11. Let p G Out s (S n ) and be such that Valj (p) G 0*l w . Then p G WlNj if, and 
only if, pG Out s {S? +1 ). 

Proof. We construct o~i that follows p and if the history deviates from this outcome, revert to 
a fixed admissible strategy. Formally, let af G <S™ + , we define o~{ by: 

• if h is a prefix of p with last(/i) G Vi, then <Tj(/i) = p\h\+i, so that we ensure that p is 
compatible with <7j; 



otherwise, let fc be the largest index such that /i<^ is a prefix of p, then <Jj(/i) = <r?(/i 



>k) 



We show that <7j is not strictly dominated. Let a' P be a strategy profile of S n whose outcome 
p' is winning for player i but such that p" = Out{cr l _ i ,o~i) is not winning for player i. We show 
that some profile in S™ t makes &[ lose. Consider the first index k such that p' k ^ p' k . The 
state p' k _i is controlled by player i. 
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If VaJ^(/o^._ 1 ) = then there is a profile r_j G <S"j that makes <r^ lose from p' fc . As there 
is a profile r^ G 5"^ that makes a% win from p'L we can combine this two strategy profiles to 
obtain one winning for <jj and losing for a\. Namely, the profile r£^ defined by 

Vj^i, r? = o-j [p' fc «- rj] [p'fe <- rj] 

is by construction such a profile. Therefore, <Tj is not strictly dominated by a[. 

Otherwise, Val"(/0j._ 1 ) = 1, we show that in fact p" is a winning path which is a contra- 
diction. If p' = p then it is winning by hypothesis. Otherwise there is some point from which 
<jj plays according to of. 

If this point is before index k. Since Valf (pfc-i) = 1 there is a strategy of player i winning 
from pk-i against all profile in S™^ As of is in 5™ + , so is afop <k _ 1 by Lemma [4.41 Therefore 
&i ° P<k~X should be winning from pfe_i against all profiles in <S™j. Hence p" is winning for 
player i, which is a contradiction. 

Otherwise, let k! be the index at which <Tj starts playing according to of. As Val"(p/c-i) = 1 
and k! > k, Val"(pfc'_i) = 1. Moreover p' k , is a successor of py-i which is not controlled by i, 
so Val(p' fc '/) = 1 by Lemma H~8l Therefore of o p<k'-i should be winning from p k _ 1 against all 
profile in S r ^ i . Hence p" is winning for player i, which is a contradiction. 

This shows that <Tj is not dominated with respect to S n . 

Reciprocally, assume that Oi G <S™ + . Let A; be a index such that Val"(p&) = 1. There 
is a strategy of player i that is winning from p k against all strategies of S n . By Lemma 14.41 
o% o p<k is also in S™ + . Therefore <Tj o p<k also has to be winning against all strategies of S n . 
As p>k is compatible both with a profile of <S" and ctj o p <k , it is winning for player i. Hence, 
by prefix independence of the objectives, p is winning for player i. □ 

4.2.2 Value -1. 

If the run reaches a state of value — 1, then, from there, there is no possibility of winning, 
so any strategy is admissible. We just have to make sure that the state of value —1 was not 
reached by player i's fault. 

Lemma 4.12. Let p £ Out s (S n ) be such that Val"(p) G $*{-!)", then p G 0ut 8 {Sl ii S%+' 1 ) 

if and only if, Mk, p k G Vi => Val"(p fc+ i) = Val™(p fc ). 

Proof. We construct a strategy ai that follows p and if the history deviates from this outcome, 
revert to a fixed admissible strategy, in the same way that we did in Lemma 14.111 for value 1. 
We define cj, by: 

• if h is a prefix of p with last(/t) G Vi, then Cj(/i) = p\h\+\i so that we ensure that p is 
compatible with ctj; 

• otherwise, let k be the biggest index such that h<_k is a prefix of p, then <tj(/i) = af(h > k). 

We show that <tj is not strictly dominated. Note that starting from a state s ^ po means 
<7j plays according to an admissible strategy. Hence only the case of plays starting from po 
remain to be considered. 

Let a'p be a strategy profile of S n whose outcome p' is winning for player i but such that 
p" = Out po (a'_ i ,ai) is not winning for player i. Consider the first index k such that p' k ^ p' k . 
The state p' k _ 1 = p"k-\ i s controlled by player i. In order to show that a[ ^s™ ®i, we build a 
profile that makes a\ lose and Uj win. 

If Val™(p^._ 1 ) = —1, then p' cannot be a winning path, this is a contradiction. Otherwise 
Valf {p'k-i) = 0. Then there is a profile in «S"j that makes a\ lose from p' k . 

Now we find a profile that makes <Tj win from p' k . 
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If p<k~i i s n °t a prefix of p, then <tj plays according to an admissible strategy. As 
Valf (p'l_i) = 0, there is a strategy profile that makes the strategy <7j o p" <k win. 

Otherwise, p< fc _ 1 is a prefix of p. Since p^ —1 = Pfe_i is controlled by player i, Valf(pk) = 
Valf(pk-i) = by hypothesis. Let k! be the largest index such that Valf(pk') = 0. 
Since Valf (p^'+i) = — 1, state pp.' is not controlled by i. Prom p^/ there is a strategy 
profile <7p that makes <rf win. Note that profile <t"j deviates from p at that point since 
Val™(pfc' + i) = —1: a'Li(p<k') 7^ Pfc'+i- As a result, after p<k>, strategy Oi follows erf. 
Therefore the outcome produced by a'^ and <jj is winning from p^ . So there is also a 
profile in S^ that makes <7j win from p'^. Namely: 



a"{h) 



pi + i if h = p<i with £ < k' and p^ G Vj 
<r''(/i) otherwise 



We can combine the strategy profile that makes a[ lose with a'" i win to obtain one that is 
winning for <Tj and losing for a^. Hence <Tj is not strictly dominated. □ 

Example 4.13. As an illustration of Lemma 14.111 and Lemma 14.121 consider the first game of 
Figure El Both paths so • si • S2 ■ T and sq ■ s\ ■ S2 ■ J- in this game can be the outcome of a non 
dominated strategy of player 1. This is because the play that goes to T is winning and the 
value of the path that goes to _L belongs to 0*(— 1)^, and the decrease in value is performed 
by player 2. 

4.2.3 Value 0. 

This case is more involved. From a state of value 0, an admissible strategy of player i should 
allow a winning run for player i with the help of other players. 

We write H™ for set of states s controlled by a player j ^ i that have at least two successors 
that (i) have value or 1 for player i and (ii) have the same value for player j than s after 
iteration n — 1. Formally, for n > 0, the "Help!"-states of player i are defined as: 



ieP\{i} 



3s', s". s' ^ s" As -> s' As -> s" 

A Valf(s') >0AVal"(s") >0 

A Val^^s) = Val™- V) = Val™- 1 ^") J 



These states have the following property. 

Lemma 4.14. Let p G Out s (S n ) be such that Val"(p) = W . Then p G Out s (S™ +1 ) if and 
only if p G WlNj or Inf (p) <T\ Hf / 0. 

Proof. Assume first that there is only a finite number of visits to Hf and that p is not winning 
for player i. Let k be the greatest index such that pt G H?. Let ap G S n be a profile such 
that Out(o~p) = p. We will show that the strategy for player i in this profile, namely o%, is 
strictly dominated with respect to S n . 

First, we show that after some prefix of p no profile of S n can make Oi win. Let a_j G S^ 
and consider the profile a'_ t = a-i [p<fc+i ■*— oc~i\ that follows ap until pk+i- Let p' the outcome 
of (<Tj, <r^_j). If p = p' then a^ does not make <7j win. 

Otherwise, consider fc' the first index where pfc> 7^ pl'> and j the player controlling state 
s = Pk'-i = Pk>-v we have that j ^ i. Since <r' G «S^, Lemma I3~9l yields that Val™ - (p' fe/ ) = 
Val™~ (p'fc'-i)- Similarly, since <Tj 6 5™, we also have Val™~ (pk 1 ) = Val™~ {pk'-i)- Therefore 
\al n f l {pk>) = \sl n f l {p'k') = Val™ _1 (s). Recall that Valf(p) = (F so VaJ?(p fc /) = 0. Since 
Pk'-i -fff , it must be the case that Val™(p' fc/ ) = — 1. Therefore no strategy profile in Ylj^ <S? 
makes Oi win from pk+\- 
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Figure 5: 



Secondly, since Valf (pk) = there is a strategy profile a'p of S n whose outcome is winning 
for i from pk- Hence <Tj [p<k <— <j'{\ strictly dominates <7j, and a; t S™ + . 

Assume now that either p £ WiNj or there is an infinite number of indexes k such that 
Pk € Hf. Let Oj be a strategy in 5™ + . We build <7j so that it is compatible with p and 
revert to a, in case of a deviation. Formally, for a history /i, such that last(/i) is controlled by 
player i: 



if /z 

p); 



p<k for some index k then <7j(/i) = p^+i (this ensures that <Tj is compatible with 



• otherwise, let k be the largest index such that p<k is a prefix of h, then <Tj(/i) = oti{h>k+i)- 

We now show that a% is not strictly dominated. Assume that there is a strategy profile 
a' p G S n such that />' = Outia'^ a[) € WiNj and p" = Outio'^oi) £ WiNj. We show that 
there is a profile that makes Oi wins and a\ lose, so that a[ does not strictly dominate <Tj. 

We consider the points where p" diverges from p and p' , respectively. Formally, let k (resp. 
k') be the largest index such that p" <k = p<k (resp. p" <k , = p' <k >)- We distinguish two cases as 
illustrated in Figure [5j 

• If k! > fe, i.e. p" diverges from p before diverging from p' . Since on is not strictly 
dominated, from p k+ i there is a strategy profile a'^_ i that makes Qj win and a[ o p" <k 



lose. Hence c/_j 
dominates <t,-. 



P< fe ' 



(7 



makes <Tj win but not a'^ Therefore a[ does not strictly 



In the other case, k' < k, the point where the two outcomes diverge is along p. We 
have p<k> = p'<k>- We write s = p' k , = pk>, which is controlled by j ^ i, s' = p' k r +1 , and 
s" = Pk'+i = &i{p<k') = Pk'+v Notice that Val™(s') < because Val"(s) = and using 
Lemma 14.81 Hence there is a strategy profile a_^ in S n that makes a[ lose from s' . 

— If p is a winning outcome for player i, we consider the strategy profile: 



o_ 



P<k'+1 ^~ a -i 



[P<k'+1 ^— CT-i O p<k'+l] ■ 



Combined with <7j, its outcome is p and therefore is winning. This strategy profile 
belongs to S n by Lemma 14.51 and makes ctj win and a' t lose, hence a\ does not 
strictly dominates ctj. 

Otherwise, there is an infinite number of states in Hf along p. Let k" be the index 
of the first occurrence of H™ after the divergence: the smallest k" > k' such that 
Pk" € Hf. State pk" is controlled by a player j ^ i. We consider a strategy profile 
Op such that: 
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* <? d j{Pk") = s d such that s d / Pk"+i, with Val™(s) > 0, and Val" 1 (pk") 

in— 1 



Val™ (s d ). This state exists since p k » G Hf. 

* Then from s d it follows a strategy profile a'^ G S2_ i that makes oti win. This 
profile exists since a>i G Sf +1 and Valf (s d ) > 0. 

The profile Op belongs to <S"j. Indeed, all players but j play according to a strategy 
of S™i by construction. In the case of player j, it first involves a step that does not 
change the value Val" -- , so by Lemma I4"7T1 it is also admissible. 
We consider the strategy profile: 



a_ 



P<k' 



a_ 



P<k" 



This strategy profile belongs to S n by Lemma 14.51 and makes <Tj win and a[ lose, 
hence a[ does not strictly dominates <Tj. 



This shows that <Tj is not strictly dominated and belongs to S, 



n+1 



u 





Figure 6: Two games. The goal for player 1 is to reach T. 



Example 4.15. As an illustration of Lemma 14.141 consider the two games in Figure [6j A 
strategy of player 1 can either stay forever in the loop between sq and si or get out after a 
number k of steps. In the first game, the strategy of player 1 that stays in the loop (sosi) 
forever is strictly dominated. This is because it has no chance of winning, while getting out 
after k steps can be winning if player 2 collaborates. In the second game, the strategy that 
always chooses S3 from si is admissible. Consider the strategy of player 2 that goes to state T 
at the fe + l-th visit of state S3, and makes strategies of player 1 lose if S2 is visited beforehand. 
This difference is characterized by state S3 G H® being included in the loop for the second 
game. 



4.2.4 Bounding the number of iteration phases. 

We can easily show that Val"(s) = 1 => Val™(s) = 1 as winning strategies are admissible 
and 5™~f~ C 5™j implies that winning strategies remain winning. Similarly, we can show 
Val™(s) = — 1 =^> Val™(s) = — 1. So the number of times that the value function changes is 
bounded by \P\ ■ \V\. This allows us to state this bound on the number of iterations neccessary 
to reach the fixpoint: 

Proposition 4.16. S* = 5> p y 

Proof. Since S n+1 C S n , a state that has value / at a given iteration cannot change its 
value at a subsequent iteration. Hence there are at most \P\ ■ \V\ changes of value during the 
iteration process. Since admissible strategies depend only on the values (even through the 
"Help!" -states), the strategy elimination stops when the value stops changing. □ 



19 



4.2.5 Automata for Out(S n ). 

The above characterization of admissible strategies with respect to values of state allow to 
define an automaton that recognizes 0u£(iS™,tS™^ ). In turn, this provides an automata-based 
representation of Out(S n ). This construction also relies on the notion of value at the previous 
iterations. 

We start by defining an automaton Af, for n > 0, that recognizeqfj Out{Sf,S n ^ ). 

• The set of states is V, the same states than in Q; 

• From the initial set of transitions we remove the ones controlled by player i that decrease 
its value. Formally: 

T = E \ {(a, s') | s G Vi A Val^^s) = A Val^V) = - 1 }- 
This is to ensure that player i cannot decrease its own value. 

• A run p is accepted by A™ if one on the following condition is satisfied: 

- — - n—l 

-VaL, (p) e o*(-l) w ; 

- VaL. (p) G 0*1" and p G WlNjj 

- Val" _1 (p) G 0" and p G WIN; or p G (V*^ 1 )". 

Notice that the structure of the automaton is a subgame of Q. We prove the following 
lemma that shows the relation between automaton A™ and outcomes of admissible strategies 
(at step n). 

Lemma 4.17. C(Af) D Out{S n - 1 ) = Ou^Sf.S 7 ^ 1 ) 



-n-l 



Sketch. For any run p, there are three cases to distinguish, based on Valj (p). The case 0*1" 
is solved by LemmaUTTJ the case 0*(— 1)" by Lemma r4.12l and the case 0" by Lemma r4.14l D 

Proof. Let p be the outcome of a strategy profile in 5 n ~ 1 that is also accepted by Af. Note 
that proving that p G Out(Sf) suffices to prove that p G Out(S™ , S™^ ). 

There are three different cases, depending on which part of the accepting condition of A? 
is fulfilled. 

• If Valj 0) e 0*1", then p G WIN*, so Lemma ED yields that p E Out{Sf). 

- — - n—l 

• If Valj (p) G 0*(— 1)", the definition of T ensures that for any index k such that p/~ G Vi, 
Val™~ (p k ) = Val™~ (Pfc+i). Thus Lemma gjj yields that p G Out(Sf). 

^^_ n i 

• Otherwise Valj (p) G 0", and p G WlNj or there is an infinite number of visits to H™~ . 

Then Lemma 14.141 allows to conclude. 

Reciprocally, let p G Out(S^,S^~ ). By monotonicity of the sets of admissible strategies, 
p G Out(S n ~ 1 ), so it remains to be proven that p G C(Af). Notice that since p G Out(S n ), 
p $l B'- 1 , so p is actually a run of Af. 

Now by Lemma 14,101 we can consider the three following cases for Val™ - (p). 

• If Valp 1 ^) G 0*(-l)", then p G C(Af). 

5 Since the transitions of Q bear no label, the "language" of an automaton is here considered to be the set 
of accepting runs. 
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• If Valf _1 (p) G 0*1". Let us write p = Out{(Ji,a_i) with ^ G 5™ and a^ L G S!^ 1 . 
Let s be the first state of value 1 encountered in p. From s there exists a strategy o~f 
for player i winning against all other strategy profiles of 5™~ . Therefore if <7j is not 
a winning strategy, erf ^^-i <7j, which is a contradiction with the fact that <7j G <Sf . 
Thus <7j is a winning strategy so p G WlNj and therefore p G £(„4f ). 

• Otherwise Val™~ (p) G W and Lemma 14.141 allows to conclude that either p G Win^ or 
p e (F*^- 1 )^ therefore that p G £(.4?). □ 

We deduce from the preceding lemma the following property: 

Lemma 4.18. Out{S n - 1 ) n f) ieP £(A?) = Out{S n ) 

Proof. 

Outis 12 ' 1 ) n p| £(A") = p| 0C(A") n o^s™" 1 )) 

ieP 

(by Lemma I4.17P 

= ( p 0ui(«SP)J nOut(S n ' 1 ) 
\ieP J 

= Out{s n ) n Out{s n - 1 ) 

OutiS 11 ' 1 ) n p C(A?) = Out{S n ) because 5 n C 5 n_1 D 

iGP 

As Out(S°) is the set of all runs over Q, the previous lemma allows the construction of 
Out(S n ) by recurrence, for any n. 

Note that the size of the automaton accepting Out{S n ) does not grow since all automata in 
the intersection share the same structure as Q (although some edges have been removed). The 
accepting condition, however, becomes more and more complex. Nonetheless, if for all j G P, 
WiNj is defined by a Boolean circuit, the condition of the automaton accepting Out(S n ) is 
a Boolean combination of such conditions, thus it is also expressible by a Boolean circuit, of 

polynomial size. For example, condition Val™~ (p) G 0*l w can be expressed by a circuit that 
is the disjunction of all states of value 1 at step n — 1. 

4.3 Inductive computation of values 

In this section, we show how to compute the values of the states for all players. Initially, at 
"iteration —1" all values are assumed to be 0, and 5 _1 = S. Computing the values at the 
next iteration relies on solving two-player zero-sum games with objectives based on outcomes 
of admissible strategies. 

For example, in order to decide whether a state s has value 1 for player i at iteration 0, 
i.e. whether Val^(s) = 1, one must decide whether player i has a winning strategy from s 
when playing against all other players. This correspond to the game with winning condition 
WiNj where vertices of all players but i belong to a single opponent. To decide whether 
Valj (s) > — 1, all players try together to make i win. Therefore this is a one-player game (or 
emptiness check) on Q with condition WiNj. All the other states have value —1. 

This idea is extended to subsequent iterations, although the objectives of the games become 
more complex, in order to take into account the previous iteration phases. More precisely, the 
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objectives need to enforce the fact that only outcomes of admissible strategies (at previous 
iterations) must be played. Hence the construction relies on the automata Af built above. 

Assuming winning conditions for all players are expressed by Boolean circuits, this yields 
a polynomial space algorithm to compute the value of all states, for all players. 

In the sequel, a strategy or an outcome "winning for objective X" is said X -winning, as 
not to confuse with simply winning, meaning "winning for objective WlNj" (i being usually 
clear from context). 

4.3.1 Characterizing states of value -1. 

A state s has a value > — 1 for player i at step n if there is a strategy profile up £ S n whose 
outcome is in WlNj. This is expressed by: Bap £ S. up £ S n A Out s (o~p) £ WlNj. This 
prompts the definition of the following objective: VP" (s) = Out s {S n ) n WlNj. 

Lemma 4.19. //*"(«) ^ 0, then there exists a profile ap £ S n such that Out s (ap) £ WlNj. 

Therefore, since the set Out s {S n ) is expressed as the language of an automaton, and WlNj 
can clearly be defined as the language of an automaton, testing whether a state has value —1 
boils down to emptiness check. 

4.3.2 Characterizing states of value 1. 

A state s has value 1 for player i at step n if he has a strategy Cj in Sf such that for all 
strategies er_j in S™ ri , 0ut s {ui,(7-i) £ WlNj. This is expressed by the formula: 

3<Ji £ Si. Vo_, £ S-i. fa £ Sf A (a-i £ Sit => WlNf(<7;,a_;))) . 

This prompts the definition of the objective ^lf(s) given by the language: Out s {Sf)r\{Out s {S n ) => WlNj 
We show that there is indeed a correspondence between this objective Qf and states s such 
that Valf (s) = 1. 

Lemma 4.20. If <Ji £ Si is a $7™ (s) -winning strategy, then there exists o\ £ Sf such that 
di(s ■ h) = a'^s ■ h) for any history h. 



Proof. Let a^ £ Sf. We show that for runs starting from s, o~i is admissible. That directly 

I 




i 

yields the result with a\ = of [s ^— Uj 

We only consider runs starting in state s. We show that o~i is not strictly dominated 
with respect to 5 n_1 . Assume there exists a strategy profile a P £ S n ~ l whose outcome p' is 
winning for player i, but such that p = Out s (ai,a'_ i ) is not winning for player i. Let k be 
the first index where p^ ^ p' k . By hypothesis that Oi is J7"-winning, p £ Out s (Sf) and is 
the outcome of an admissible strategy «j £ Sf. Note that p = Out s {ai,a'_ i ) and is losing, 
while p' = Out s (a' i ,a'_ i ) is winning, with a'_ { £ <S™~ , so a« ^s«-i (?'i- By admissibility of ««, 
a i /5»-i a i, therefore a\ )£$ n -i on. Hence there exists a'^ £ S n ~ l that makes a[ lose from 

P'k- 

Now, G{ is winning for objective Qf, and since p<^ is compatible with o~i, it is ^"-winning 

from pk- In particular, if all players j / i play according to a strategy of SH i it is winning. 

Since the condition V u \ Out s {S' n i i ) cannot be satisfied, condition WlNj is satisfied. Therefore 

the strategy profile a'^ £ S n ~ l makes o"j win. Recall that a'!_ t also makes a[ lose from p' k . 

Hence <7j is not strictly dominated with respect to <S™~ and it belongs to Sf. D 

Proposition 4.21. A strategy of player i is a strategy of Sf which is winning from state s 
against all strategies of S T t i if, and only if, it is winning for objective Qf(s). 
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Proof. Assume ctj is a strategy of S™ which is winning from s against all strategies of <S"j. 
Consider a strategy profile <7_j and the run they produce: p = Out s (ai,a-i). Obviously 
p G Out s (Sf) because <7j G Sf. If p G Ou£ s (<S"j), as <7j is winning against the strategies of 
«S"j this means that p is winning for player i. Hence either p G WlNj or p G F" \ Oui s («S"j) ■ 
So <7j wins for condition £lf. 

Reciprocally, let Oi be winning for £lf(s). Lemma 14.201 shows that o~i can be completed 
as a strategy of Sf when starting from states other than s. We now show that it is winning 
from s against all strategies of S r ^ i . Let <t_j G S^ i and p = Out s (ai,a~i). The path p is in 
Out s (S r ^ i ), so since <Tj is winning for O™, it means that p € WlNj. Hence <7j is winning from s 
against all strategies of 5"^ . □ 

Notice that if player i takes a transition decreasing his value, we know that it is not playing 
a winning strategy. Conversely, if a player j ^ i takes a transition that decrease her value 
then we immediately know that player i has a f2™-winning strategy: by playing an admissible 
strategy. We can therefore consider these two cases separately. We define the set B™ and Cf 
by: 

Bf = {peV"\ 3k. p k G V^VairHpfc+l) < Val™- 1 ^)} 

Cf = {p G V" | 3k. Pk G F^i / *, Val^Cpfc+i) < Val™- 1 ^)}- 

We also define: 



Bf n = JB™ Cf n = \j Cf, 5C™ = V" \ (£^ n U Cf 1 ) 

m=l m=l 

Lemma 4.22. For any player i and iteration n, the following implications hold: 

(1) IfpG Out(S?), then p i Bf n . 

(2) If pe OutiSli), then p £ Cf n . 



(3) Ifpe Out(S n ), then p G BC\ . 
Proof. Since Out(S™~ ) C Out(Sf), it is sufficient to prove the following. 
(1') If p G Out(S?), then p £ Bf. 
(2') If p G OutiS^), then p £ Cf. 



Implication (!') holds because of Lemma 14.91 Implication (2') is obtained by applying the 



same lemma to players j ^ i. Implication | (3) | is a consequence of (1) and (2) □ 



Objective Qf can be further decomposed with respect to these sets. 
Proposition 4.23. There is a winning strategy for £lf(s) if and only if there is one for: 

e?(s) = cf n u(m;nn?(s))- 

Proof. Objective O" can be rewritten 

e?( s ) = cf n u (V \ Bf n ) n or \ cf n ) n n?(s)) . 

Let <7j be a Q™(s)-winning strategy. Let p G Out s (oi). Note that since <7j is f^(s)-winning, 
player i never decreases its value in p, therefore p G {V w \ B~ n ). Therefore 
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• either p G Cf n C 0J» , 

• or/)Gr\ Cf n , then pe(F w \ £^ n ) n (V" \ Cf n ) n Of (s) £ ©f (s). 

Therefore a ctj is also winning for Of. 

Reciprocally, if o~i is winning for 0f (s). We build a f2f (s)-winning strategy <r^ as follows. 
Let cuj € <S" be an admissible strategy for player i. We set a\ that plays like Oi until a player 
j ^ i decreases its value, then plays like on. 

Note that Oi never decreases the value for i before shifting to a{. Indeed, assume against a 
profile cr_j, player i decreases its value after a history h (where no other player has decreased 
its own value). Let a'_ { be a (positional) profile that never decrease a value for j ^ i at any 
iteration and p = Out s {tJi,tJ-i [h -(— a^]). Then p ^ C^-" while p G Bf C -£>- n , so p ^ 0", 
which is a contradiction with the fact that <Tj is Of -winning. 

As a result, applying Lemma 14.71 several (but a finite number of) times yields that a\ is 
admissible. So every run produced by a[ starting from s is by definition in Out s {Sf). Also 
remark that a[ is a 0™(s)-winning strategy. 

Let O-i be a profile and let p = Out s (a' i ,a^i). If for some j ^ i, p ^ Out s (Sj I ), then 

p 6 fi?(s) because p ^ Out s (S^ i ). Otherwise, by Lemma[02l p i Cf n thus p G Slf (s). D 

4.3.3 Using the automata. 

We can now use the acceptance conditions of automata (A 7 j l ) m <n,jeP to rewrite Of. Note 
that the state s is only relevant as the starting point of the runs, we can consider winning 
condition Of regardless of the initial state: 0" = \J seV &f(s). Remark that we also have 
Qf( s ) = @f n (s ■ V"). 

If we expand the definition of Uf in 0", we obtain: 



o™ = cf n u (bc; n Out(s?) n (Out(s n ) => Win;)) . 

The set Cf n is easily definable by an automaton, so is WlNj, hence we just have to construct 
automata recognizing Out(S n ) and Out(Sf) n BC i . In the former case, this is done through 
an intersection of automata {A^ l ) m <n,j£Pi as shown in Lemma 14.181 in Section [4.2.51 We now 
consider the latter case. 



Computing Out{Sl l ) n BC i . The construction for the language Out{Sf) n BC i is also 
based on the automaton A™. For this, we show that it can be defined through a combination 
of Out{Sf,S 1 ^~ ) and of outcomes of admissible strategies at the previous iteration. Namely: 



Lemma 4.24. 



Proof. 



C 



Out(s?)nBc; = Out(s?- l )nBc; 

n {Out{s n - 1 ) =► Out{s^s^ 1 )) 

The inclusion holds because <S" C 5™~ and 



D 



Ou^s?) n Out(s n ~ L ) = Out(s?,s^ 

In the other direction, let p be such that 

p g 5C™ n Owi^f- 1 ) n (Outis 11 - 1 ) => 0ut(5f, si^ 1 )) . 

If p is an outcome of <S n_1 then it is an outcome of (5",5™~ ) and therefore in Out{S^). 
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Otherwise, p is in Out(S^ ) \ Out(S n 1 ). Let a, be a strategy of 5", we define at that 
follows p and revert to a% if the history deviates from p. Formally, for a history h, such that 
last(/i) G Vi\ 

• if there is k such that /i = p<k, then <7j(/i) = Pk+i] this is to ensure that p is an outcome 

Of Gi\ 

• otherwise let k be the last index such that p<k is a prefix of h, then <7j(/i) = ckj (/&>&). 

Note that Out(ai) n 23™ = 0. Indeed, the only outcome of <7j which might not be in Out{Sf) 
is p which does not belong to Bf by assumption. 

We show that oi is in Sf. Assume there is a strategy profile a p G 5 n_1 whose outcome p' 
is winning for player i but such that p" = Out(a{, cr'_j) is not. The path p" is different from p 
since it belongs to Out(S n ~ l ). 

However, as noted before, p" £ B™. Let k (resp. k') be the first index where p" differs 
from p (resp. p'). We distinguish two cases, once again as in Figure [5J If k' > k, Oi is playing 
according to a non-dominated strategy from p<k+i, hence it is not strictly dominated by a[. 

Otherwise, k! < k. Let s = p k ,, it is controlled by player i. Let s' = a'^p^k 1 )-, and 
s" = <Ji{p< k i). Note that since p £ Bf, Val^s) = Va!?" V)- Additionally, if Val^s) > 
Val™~ (s'), then a profile that fares better for <7j than for a[ can easily be found, so a\ ^ 5 «-i a{. 
Therefore we assume Val™~ (s) = Val™~ (s') and distinguish cases according to the three 
possible values. 

• If Val™ - (s) = —1, then it is not possible for a p to be winning, hence a contradiction. 

• If Val™~ (s) = 1. First assume that Val"~ {p'k+i) = 1- Then, since <Tj plays according 
to a strategy of 5" after /0> fc+1 , p" is a winning path. This contradicts our hypothesis. 

Otherwise, consider the first state of p'l, k , that does not have value 1: the smallest k" > k! 
such Val™ - (p'k») < 1- As a result, and since p" ^ -B™, p" k n = pk» G Vj for some j ^ i. 
Since p Cf , Val™"^^,,) = Var™~Vfc»-i)- By Lemma Ml from the strategy of S^J 1 
from p" k n that makes player i lose, we can construct another one that makes player i lose 
from Pk„_ 1 - This contradicts the fact that Val™ - (p'k"-i) = -*■• 

• If Val™ - (s) = 0. Then one can find a profile that makes a[ lose. First assume that 
Val n_ {p'k+i) — 0- Then a profile can be found that makes <7j win, since a, L plays 
according to an admissible strategy from that point. 

Otherwise, consider the step in which a player j ^ i decreases Val n ~ : the smallest 
k" > k! such Val n ~ (Pk"+i) = ~ 1- We have that /?&" € Vj for some j ^ i- Since 
Val n_ (/?&") = 0, there exists a successor state of pk» of the same value for player j 
that is of value > for player i: a state q ^ Pk"+i such that py — > q, Val n_ (q) > 0, 
and Val n_1 (pfc//) = Val n ~ 1 (g). Then from q there is a profile <7^ G S™^~ that makes <7j 
win, since <Tj plays according to an admissible strategy from that point. Notice that the 
profile that plays like a'_ i up to pk» then goes to q and shifts to a'^ is still a profile of 

Hence <7j is admissible and p G Out(Sf), which concludes the proof. □ 

Lemma 4.25. 

Out(s?)nB~c? = Out{s?- 1 ) dbc™' 1 

n (Outis 11 - 1 ) =» £(A")) 
n {V" \ B?) n (y u \ C") . 
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Proof. Remark that Br n = B? U Bf n ~ x and Cf n = C? U Cf n ~\ so 



><n i i /i<n\ 



sc; = y w \ (sf n u c^ n ) 

= V" \ (5f u Bf n - X u cj* U C^ n_1 ) 

= (V w \ (sp- 1 u c^ 1-1 )) n (y w \ sf ) n (y w \ cj 1 ) 

BC™ = B~C n ~ 1 C\{V u, \BY)C\{V ul \C?). (1) 

In addition, Out(S?, S^ 1 ) = Out{S n ~ x ) n£(Af), so 
OutiS'"- 1 ) =* 0^(5f,5!!7 1 ) = 

Out^- 1 ) =* 0^(5™,5!!7 1 ) = 0«i(5 n - 1 )=>AA")' ( 2 ) 

Rewriting Lemma 14.241 with Equations (pQ) and (J2J) yields the result. □ 

The previous lemma provides a recurrence relation to compute the intersection Out(Sf) n 
.BCj , with base case being all the runs of Q. 

AA Algorithm for circuit conditions 

The above construction yields procedures to compute the values, and in turn to solve the 
winning coalition problem. 

Proposition 4.26. Checking whether Val"(s) = 1 is in PSPACE. 

Proof. We define the following two-player game Qf as follows. Qf has the structure of Q, except 
that the edges corresponding to a player lowering its own value at any previous iteration are 
removed (thus avoiding B- n and C- n syntactically). The players are Eve and Adam, the states 
of Eve are Vi and the states of Adam are [L-^ Vj. The winning condition for Eve is O", which 
is a circuit condition. 

If Eve has a winning strategy starting from state s, then Val"(s) = 1, as shown by Propo- 
sitions H22and H23J Recall that for circuit condition, deciding whether there exists a winning 
strategy for Eve is in PSPACE [13]. □ 

Proposition 4.27. Checking whether Valf(s) = —1 is in coNP. 

Proof. This is done by checking the emptiness of \l/" when starting from state s. Again, this 
is a circuit condition on Q where edges lowering the value of their owner have been removed. 
The emptiness check is in coNP since testing non-emptiness amounts to guessing a valuation 
satisfying the circuit then guessing a lasso path starting from s and looping in exactly the 
states of the guessed valuation. □ 

Theorem \4-l\ Let W, L be the set of players that must win and lose, respectively, in the 
instance of the winning coalition problem. The winning coalition problem is thus equivalent 
to the non-emptiness of 

$ = Out(s*) n p| Win; n p| ^Winj 

ieW i€L 

over Q, which is a circuit condition. This check is done in NP. 

This however requires the computation of the condition corresponding to Out(S*), hence 
of the values for all intermediate iterations before the fix-point. Each iteration means solving 
a circuit game, which is done in polynomial space. Moreover, by Proposition 14.161 there are 
at most \P\ ■ \V\ iterations. Thus the overall complexity is in PSPACE. □ 
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4.5 Biichi objectives 

In the case where the winning conditions for each players are Biichi objectives, a careful 
analysis of condition 0™ shows that it can be reformulated as a parity condition. Hence 
computing the value of a state boils down to solving two-player parity games, which can be 
done in UP n coUP (and is suspected to be polynomial). 

Theorem 4.28. The winning coalition problem with Biichi objectives is in A^. Moreover, if 
there exists a polynomial algorithm for solving two-player parity games, then winning coalition 
problem with Biichi objectives is in P. 

In this section, We assume that each winning condition WlNj is given by a Biichi set -Fj. In 
this special case, we show that the objective 0™ can in fact be written as a parity condition. It 
follows that if we are given an oracle to solve two-player parity games, we have a polynomial 
algorithm. Parity games are known to be in UPncoUP, but the question whether a polynomial 
algorithm exists for parity games has been open for several years |144 \7\ . A parity condition 
is given by a coloring function \ '• V ~ > {0, • • • , M} with MgN. Accepted runs with respect 
to the coloring functions are the ones where the maximal color visited infinitely often is even: 
WlN x = {p | max(Inf(x(p))) is even} . 

4.5.1 Expressing 0j as a parity condition. 

First note that the acceptance condition of C(Af) can be expressed by the following Biichi 
set, assuming that we remove all the edges that decrease the value of player i: 



ir i ( S ) = -i}u{,|vair i ( 

U {s | Vai^s) = A s € (F t U F™" 1 )} 



Kf ={s | Val™- 1 ^) = -1} U {s | Val^Xs) = 1 A s e Ft} 

m — 1/„\ HA „ r- (T? I i un—l\ 



Note that Fi C Kf for every n. 

Out(S°) is accepted by the automaton with the same structure as Q and where the Biichi 
set is V. Since Out{S n - r ) n f] i&P £(A?) = Out(S n ) by Lemma ESJ Out{S n ) is recognized 
by an automaton whose acceptance condition is a conjunction of n x \P\ Biichi conditions. By 
taking a product of the game with an automaton of size n X \P\, a condition Out{S n ) can be 
expressed as a single Biichi set that we write D m . 

Recall that condition 0" is 

Cf n u {BC n i n Out(S?) n (Out(S n ) =>- Win*)) . 

We isolate the prefix-independent part of 0" by defining 

17 = Out(S?) n (Out{S n ) =>■ WIN*) 

which, by unfolding the recurrence relation of Lemma 14.251 can be rewritten: 

n-l 

r^ = p| (Out(s m ) =► c(A™ +1 )) n (Out(s n ) =► wm*) 

m=0 

Note that the consequence of each implications can be strengthened by the premise: 

71-1 

rf = p| (Out(s m ) => {c{AT +1 ) n Out{s m ))) n {Out(s n ) =► wi^) 

m=0 

Also remark that the "prefix-dependent" part of 0" can be expressed by either removing edges 
(to avoid sets Bi) or adding an additional winning state (for sets Q). 
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Each set Out{S m ) is expressed as a conjunction of m x \P\ Biichi conditions. Similarly, 
condition (£(.4™ + ) n Out(S m )^ is a conjunction ofmx \P\ + 1 Biichi conditions. Therefore, 
in order to consider all these different conditions on the same game, it can be assumed that 
Q is synchronized with a product of sizqj 0(n 2 ■ \P\). Then each condition Out{S m ) can be 
expressed as a single Biichi set that we write D m . Also, each condition (Ci^A™ ) n Out(S m )) 
can be expressed as a single Biichi set that we write E™ + . 

Notice that we have a "chain" of inclusion of the various objectives. For each index m and 
player i: 

Out{s m ) n £(A™ +1 ) c Out{s rn ) c Out{s m - 1 ) n C(A?). (3) 

Hence, if in an implication Out(S m ) =4> (Out(S m ) D £(A™ +1 )) the left operand is satisfied, 
then all such implications are satisfied for indexes k < m. And if the right operand is satisfied, 
then it is the case for indexes k < m. The condition Tf can then be defined by the parity 
condition given by the following coloring function xf'- 

• if s E Fi then x?( s ) = 2n + 2 

• otherwise Xi( s ) is t ne maximum value between 0, 

2 • max {m \ s E E™} , and 2 • max {m \ s E D m } + 1, 

with the convention that max0 = — oo. 

Lemma 4.29. For all index n and player i, p 6 Tf if, and only if, p satisfies the parity 
condition xf- 

Proof. Assume p E T™. Let m < n be the largest index such that p E Out{S m ). 

If m = n then p E WiNj, therefore Fi is visited infinitely often by p. The highest color 
visited infinitely often is thus 2n + 2 and p satisfies condition xf- 

If m < n then p is not in Out{S m+l ) and therefore, for m' > m, not in Out(S m ). Hence 
p does not visit infinitely often odd colors greater than 2m + 2. Moreover, since p E T", 
p E Out(S m ) n C{A r [ l+ ) hence it visits infinitely often states of E™ 1+ , which have an even 
color of (at least) 2m + 2. This means that p satisfies condition xf- 

Reciprocally, assume that p satisfies xf- Let c be the highest color that is reached infinitely 
often. 

If c = 2n + 2 then Fi is visited infinitely often, therefore p E WiNj. Moreover, for every 
m < n, Fi C K™ so K™ is also visited infinitely often, hence p E £(-4™ +1 ) C Out{S m ) => 
(Out{S m ) n C{A™ +1 )), therefore p E Tf. 

Otherwise c = 2m + 2 with m < n. Then set E™ + is visited infinitely often while, for 
every m! > m, the set D m is not. So for m! > m, p is not in Out(S m ), hence all implications 
are satisfied of index > m. Note that it is also the case for w! = n, so p E Out{S n ) =^ WiNj. 

Moreover, since p E Out(S m ) P\ £(A™ +1 ), for all indexes m' < m, Equation ([3]) yields 

that p E Out(S m ')DC(Af +1 . So the implication Out(S m ') => (Out(S m ')n£(Af +1 )) is 
satisfied. Therefore p E T™. □ 

4.5.2 Solving the winning coalition problem for Biichi objectives. 

We showed that all objectives encountered in the computation of values boil down to parity 
objectives. This yields the following proof: 



^Precisely \P\ ■ (n - 1) ■ (n - 2) + n. 
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Theorem \4-28\ By reformulating 0™ as a parity condition, checking whether the value of a 
state is 1 amounts to solving a two player game with parity condition. This is known to be in 
UP (~l coUP, although suspected to be in P. Similarly, condition \P" is a conjunction of Biichi 
objectives, hence solving its emptiness - which means deciding whether the value of a state is 
— 1 - is in P. 

Let no be the index where the sets of admissible strategies stabilize (we have no < \P\ ■ \V\). 
Let W, L be the set of players that should win and lose, respectively. Solving the winning 
coalition problem amounts to solving emptiness of 

$ = Out{S no ) n p| WlNj n p| -.WlNi. 

i£W ieL 

As the conjunction of no + \W\ Biichi conditions and a coBiichi condition, it can be expressed 
as a parity condition with 3 colors. □ 

5 Weak objectives 

In this section, we assume that the winning conditions are weak circuit condition. We will 
show the following theorem: 

Theorem 5.1. The winning coalition problem for weak circuit conditions is PSPACE-complete. 

Proposition 5.2. For weak circuit conditions, the value of a history only depends on the set 
Occ(/i) of states that have been visited and on s = last(/i) the last state of the history. 

Proof. A weak circuit condition can be transformed into a prefix-independent one by re- 
membering which states have already been visited, this is a consequence of the fact that for 
prefix-independent objectives the value depends only on the last state of the history. □ 

We will thus simply write Val^(-R, s) for Val^(/i) where R = Occ(h) and s = last(/i). The 
core of the argument consists in proving that the value for given R and s can be computed in 
polynomial space. 

Lemma 5.3. For every iteration n, player i, state s, and set of states R, the value of 
Valj (R,s) can be computed in polynomial space. 

Proof. We define a recursive procedure Proc(i?, n) which computes the value V&lf(R, s) for 
each player % and state s. This procedure relies on the conditions 0" (and \P") from Section POl 
but require them to maintain R as the set of states visited so far. Namely, 

e?(R) = 0™ n Occ _1 (-R) and *?(jj) = *? n Occ _1 (i?) . 

Given R and n, Proc(i?, n) works as follows. 

• Compute the condition ®f(R). In that case WlNj is a trivial condition (either true if 
R satisfies Win, or false otherwise) so we can use the polynomial space algorithm of 
Section [H Note that the computation of this condition may require computing value of 
some state for some n' < n, this will be done by recursive call to Proc(i?, n'). 

• Do the same thing for ^f(R). 

• For each transition s — >■ s' with s € R and s' £ R we compute Val™(i?',s') with R' = 
R U {s 1 }. This is done by a recursive call to Proc(i?',n); note that R' strictly contains 
R. 
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• If from s, there is a strategy of player i such that any outcome either: 

— stays in R and is winning for @f(R); 

— or the first state reached outside of R has value 1; 

then s has value 1. 

• If there is no strategy profile that satisfies $™(i?) and no profile whose outcome from s 
leaves R for s' £ R with Valf (i? U s', a') > 0, then s has value — 1. 

• In the other cases s has value 0. 

At each recursive call either n decreases or the size of R strictly increases, therefore the 
height of the stack of recursive call is bounded by n + |V|. The computation, ignoring recursive 
calls, can be done in polynomial space. Thus the global procedure works in polynomial 
space. □ 

Theorem \5.1[ Let W and L be the sets of players that should win and lose, respectively. We 
guess a lasso path p such that Occ(p) = R such that for i G W, R \= ipi and for i S L, R¥ ipi, 
where for i 6 P, <pi is the formula over V defined by the circuit for the winning condition of i. 

Let no be the iteration after which the values do not change, and assume we have, with 
Proc(i?, no), computed the values for all players and states. 

We check that p is the outcome of an admissible profile. In order to do that, p is divided 
into p = p\ ■ p%. Note that we can choose Occ^i) = R, \p\\ < \V\ 2 (since a visit to a state of 
R may require a path of length at most |V|), and \p2\ < \V\ (we have also Occ(p2) != R)- We 
first check that in pi, no player ever lower its own value. 

We then check that p^-, the looping part of p, is part of an admissible profile that stays in 
R, i.e.: 

p£ g Out(s no )no<xr 1 (R) 

where Out(S n °) is computed as in Section [4.31 with trivial objectives for all players: 

no 

Out(S n °)=f]f}£(Af). 

n=0ieP 

In particular, no player can decrease its own value. Note that the definition of the winning 
condition of these automata requires the values of states at previous iterations, which is 
provided by calls to Proc(R,n). 

PSPACE-hardness is given by Lemma 13.91 □ 

In section [3l the winning coalition problem was proved PSPACE-hard even for the special 
case of safety conditions. The problem is in fact also PSPACE-hard for reachability conditions. 

Lemma 5.4. The winning coalition problem for reachability conditions is PSPACE-hard, even 
for sets of players such that \W\ = 1 and L = 0. 

Proof. This is essentially the same proof than for safety, we will therefore only insist on the 
differences. 

• If <j) = Xi we define the module M^ in which player Xi has a choice between winning or 
letting the game continue. 

• If (j> = -*Xi the construction is similar, with player ->Xi replacing Xj. 
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(a) M Xi (b) M_ a< (c) g 

Figure 7: Modules for the definition of the game Qa,. A label y inside a state q denotes that 
q € Goody] a label y 6elow; a state g denotes that q £ V y . Note that Eve is abbreviated 3. 

• The other modules are defined in the same way than in Lemma 13.91 

The game Qj, is obtained by directing the remaining outgoing transitions to a winning state 
for Eve. 

Given a history h of the game, we write j(h) = {i £ P | 3k. hf~ € Goodi} the set of players 
who already won in that history. We associate to such a set of player a valuation v™ such that: 

1 if xi € 7 

v~f(xi) = { if -ixi G 7 A Xj £ 7 

undefined otherwise 

If ^ is a literal, the strategies of «SJ are exactly the one such that if £ 7(/i) and last(/i) € V^, 
take the transition to the state in Goodi. 

Now Eve should only visit a state controlled by £ if it has already been visited in the past. 
We are in the same situation than in the proof of Lemma 13.91 so the remaining of the proof 
is exactly the same. □ 

6 Conclusion 

We presented techniques to determine the set of outcomes of iteratively admissible, yielding 
algorithms to decide several problems on the set of strategies that survive the elimination 
process. 

Given that, for prefix- independent objectives, we obtain automata that fully describe the 
set of admissible strategies, it is possible to solve more general problems than the winning 
coalition problem. 

For example, a universal version of the winning coalition problem, namely "is it the case 
that for any outcome of an iteratively admissible profile, all players of W win and all players 
of L lose?" , can be solved with similar procedures. 

More generally, one can ask whether an LTL formula is satisfied by all profiles of iteratively 
admissible strategies. Deciding the emptiness of product of the automaton for Out(S*) and an 
automaton recognizing runs that violate an LTL formula straightforwardly yields an algorithm 
for this problem. Obtaining a precise complexity for this problem will be part of future work. 

Future work also include investigating the quantitative setting, where players cannot just 
win or lose, but obtain a reward, in keeping with the original presentation of this concept for 
matrix games. 
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